Providing multiple perspectives of a venue activity to electronic wireless hand held devices

ABSTRACT

Methods and systems for providing multiple perspectives of a venue activity to electronic hand held devices. A system for providing venue-based data to venue-based wireless hand held device can include at least one processor for processing data captured by at least one venue-based video camera for transmission to remote wireless hand held devices and at least one transmitter for wirelessly transmitting the data to a the remote wireless hand held devices. Wireless hand held devices include a display screen for displaying received venue video data. A method for transmitting venue-based data to hand held devices includes steps of capturing video images from at least one perspective of a venue-based activity using at least one video camera; processing the video images into venue-based data formatted for transmission and use by at least one hand held device and transmitting the venue-based data to at least one hand held device. Hand held devices receive venue-based data, process the data for display on a display screen associated with hand held devices, and display processed data on the display screen, thereby enabling users of the hand held devices to view at least one perspective of venue-based data through the hand held devices.

CROSS-REFERENCE TO RELATED PATENT APPLICATION

This continuation patent application claims the benefit of U.S. patentapplication Ser. No. 09/902,348 filed on Jul. 10, 2001, entitled“Providing Multiple Perspectives of a Venue Activity to ElectronicWireless Hand Held Devices,” which is hereby incorporated by referencein its entirety, and which issued as U.S. Pat. No. 7,812,856 on Oct. 12,2010. U.S. patent application Ser. No. 09/902,348 claims priority toU.S. Provisional Application Ser. No. 60/243,561, filed on Oct. 26, 2000for “Providing Multiple Perspectives for a Venue Activity through anElectronic Hand Held Device,” which is also incorporated herein byreference in its entirety. This continuation patent applicationtherefore claims priority to the Oct. 26, 2000 priority date of U.S.Provisional Application Ser. No. 60/243,561.

TECHNICAL FIELD

Embodiments are generally related to wireless electronic hand helddevices, such as Personal Digital Assistants (PDAs), hand heldtelevisions, data-enabled wireless telephones, and so forth. Embodimentsalso relate to techniques for remotely delivering video-related data tohand held devices. In addition, embodiments relate to techniques forproviding increased viewing opportunities for audiences in venueenvironments, such as stadiums and concert arenas. Additionally,embodiments relate to wireless video data transmission to hand helddevices.

BACKGROUND OF THE INVENTION

Most modern stadiums and live entertainment facilities or arenas (hereinalso collectively referred to as “venues”), which feature sportingevents and concerts, typically employ large television screens thatreceive video images and are linked within the stadium to a plurality oftelevision cameras positioned to capture video images at diverselocations within the stadium. The audience at a typical sporting event,for example, can generally view advertisements, instant replays, andother sports related data on the large television screens within thesports stadium itself. Feeds are additionally generally provided fromthe cameras to announcers in a broadcast booth, replaying certain playsfrom the event so that announcers can make comments about plays, andfinally transmitting a telecast to the viewing audience, including someaspects of captured video and data to the stadium audience.

Despite the availability of such large screen television monitors, venueevent audience members still lack enhanced viewing options orperspectives within the venue itself. To compensate for the lack ofviewing options, sports and concert promoters often rent binoculars toaudience members prior to or during the event. Such binoculars canpermit the typical audience member to obtain a somewhat better, butlimited, view of the event, such as a football or hockey game, but eventhese views are often obstructed by other audience members and are tiedto only one perspective.

The large television screens placed in a venue such as a stadium aretypically linked to cameras that are fixed or mobile. Placement ofcameras about the stadium is generally tied to an enterprise system. Themovement of the game ball in a football game, for example, along withthe players on the field is dynamic and unpredictable, and may notalways be caught by the active camera having the best perspective. Thus,during a game, the large television screens typically provide only oneview, which can be further obstructed by other players or officials,often destroying a critical angular view.

In addition, such large screens are often utilized to bombard audiencemembers with information, such as advertisements, thereby cutting intovenue activity video that venue audience members might otherwise wish toview such as instant replays, a current play or other event data. Theaudience members, therefore, essentially view the large screen at thebehest of the camera operator or director and cannot select their ownviews or camera angles.

Based on the foregoing, the present inventors have found that suchlimitations in venue environments can be solved through the use of handheld devices, such as PDAs, hand held televisions, data/video-enabledcellular telephones, and other hand held wireless video-enabled devices.For example, the recent shift in the consumer electronics industry froman emphasis on analog technology to a preference for digital technologyis largely based on the fact that the former generally limits the userto a role of a passive recipient of information, while the latter isinteractive and allows the user to control what, when, and how he or shereceives and manipulates certain information. This shift in focus hasresulted in the development and increasingly widespread use of a digitaldevice generically referred to as a “personal digital assistant” (PDA).

Hand held computing devices (i.e., hereinafter referred to as “hand helddevices” or “handheld devices”) are becoming increasingly popular forstoring and maintaining information. Although PDAs may be connected to adesktop personal computer or other PDAs via infrared, direct wire, orwireless communication links, PDAs and similar hand held devices, can belinked to remote networks, such as the Internet, or local wirelessresources, such as RF broadcasts, through available wirelesscommunications techniques.

The most advanced data- and video-enabled wireless communication devicescurrently available in the marketplace take the form of a PDA (e.g.,Palm Pilot™ Handspring Visor™, and Windows CE compatible hand heldcomputers, such as the iPAQ™). Unlike personal computers, which aregeneral-purpose devices geared toward refining and processinginformation, PDAs are designed to capture, store and display informationoriginating from various sources. Additionally, while a certain level ofskill is required to use a personal computer effectively, PDAs aredesigned with the novice and non-computer user in mind.

Attempts have been made to provide venue-based, interactiveentertainment to enhance the fan experience at live events. Suchattempts utilize touch-screen technology integrated directly into seatsat outdoor or indoor arenas. Audience members, however, due to theirintegration with the viewer seat, can easily damage such devices.Systems that incorporate such devices are also expensive because theyliterally require miles of cable.

Some recently constructed arenas, for example, that implement suchseat-integrated technology are requiring hundreds of miles of electroniccabling, including audiovisual, broadcast, and multiband lines. Such aplethora of large cables are expensive and require extra space, whichoften cannot be found in older stadiums, or would require a greaterexpense to integrate into newly built stadiums. The cost of retrofittingan older stadium with such technology can be staggering. Additionally,many fans that attend games or concerts with such technology integrateddirectly into the seats may find such a feature distracting.

Another problem faced by venue promoters and arena owners who integratefixed technology directly into the seat is that such technology canquickly become obsolete. If a new facility is fitted with suchelectronic/hardware intensive technology, the technology may becomequickly outdated, requiring an expensive update and/or retrofit.

The present inventors thus realize that a solution to these problemslies in the use of wireless hand held devices. By utilizing moderntechnology integrated with hand held devices, on-demand live action,multiple camera angles, instant replays, and real-time team and venueinformation may each be readily provided to fans without the expense andproblems associated with present in-seat integrated technicalenvironments. Additionally, it is anticipated that the deployment ofvenue-based systems facilitating the use of such devices would berelatively inexpensive, at least in comparison to seat-integratedsystems. Finally, such systems will provide the venue attendee withincreased mobility and freedom of use within and throughout the venueenvironment.

BRIEF SUMMARY

The following summary is provided to facilitate an understanding of someof the innovative features unique to the disclosed preferred andalternative embodiments and is not intended to be a full description. Afull appreciation of the various aspects of the embodiments disclosedherein can be gained by taking the entire specification, claims,drawings, and abstract as a whole.

It is therefore one aspect of the disclosed embodiments to providemethods and systems for delivering venue-related data to a hand helddevice.

It is another aspect of the disclosed embodiments to provide improvedmethods and systems for delivering real time video provided at anentertainment venue to a hand held device.

It is still another aspect of the disclosed embodiments to providemethods and systems for providing multiple perspectives from a venueactivity for viewing through a hand held device.

It is yet another aspect of the disclosed embodiments to provide handheld devices and associated methods that provide on-demand video actionand instant replays from multiple camera angles focused on anentertainment venue activity.

It is still another aspect of the disclosed embodiments to provide handheld devices and associated methods that provide on-demand video actionand instant replays from one or more cameras focused on a venueactivity.

The aforementioned aspects and other objectives and advantages can nowbe achieved as described herein.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying figures, in which like reference numerals refer toidentical or functionally similar elements throughout the separate viewsand which are incorporated in and form a part of the specification,further illustrate the present invention and, together with the detaileddescription of the invention, serve to explain the principles of thedisclosed embodiments.

FIG. 1 depicts a block diagram illustrating components of a hand helddevice in which embodiments may be implemented;

FIG. 2 illustrates a pictorial representation of a hand held device,which may be utilized to implement an embodiment;

FIG. 3 depicts a pictorial representation of a hand held device adaptedfor receiving a module in accordance the disclosed embodiments;

FIG. 4 illustrates a system for providing multiple perspectives througha hand held device of activities at a venue in accordance with thedisclosed embodiments;

FIG. 5 depicts a system that provides multiple perspectives of a venueactivity through a hand held device adapted to receive and process realtime video data in accordance with the disclosed embodiments;

FIG. 6 depicts a system for providing multiple perspectives of activityat a venue through a hand held device adapted to receive and processreal time video data in accordance with the disclosed embodiments;

FIG. 7 depicts a system for providing multiple perspectives for activityat a venue at a first time/perspective and a second time/perspective inaccordance with the disclosed embodiments;

FIG. 8 illustrates a system for providing multiple perspectives througha hand held device of an activity at a venue including the use of awireless gateway in accordance with the disclosed embodiments;

FIG. 9 depicts a system for providing multiple perspectives through ahand held device of a venue activity, in association with a wirelessnetwork in accordance with the disclosed embodiments;

FIG. 10 illustrates a diagram depicting network attributes of a wirelessnetwork that may be utilized in accordance with the disclosedembodiments;

FIG. 11 depicts a prior art overview display and a detail window;

FIG. 12 illustrates a prior art spherical image space divided into aseries of w rows and q columns, with the rows and columns representingindividual frames as photographed from a video camera;

FIG. 13 depicts the two-dimensional representation of the sphericalimage space of FIG. 12 into rows and columns of image frames;

FIG. 14 illustrates a prior art overview display, a detail window and acorresponding area indicia (geometric figure outline);

FIG. 15 depicts a prior art series of saved geometric figure outlinescorresponding to user selections in tracing through an overview imagedisplay for subsequent playback, which may be utilized in accordancewith the disclosed embodiments;

FIG. 16 is a prior art flowchart providing a logical process forbuilding an overview image, which may be adapted for use in accordancewith the disclosed embodiments;

FIG. 17 illustrates a prior art flowchart illustrative of a logicalprocess for playback interaction, which may be utilized in accordancewith the disclosed embodiments;

FIG. 18 depicts a pictorial representation illustrative of a VenuePositioning System (VPS) in accordance with the disclosed embodiments;

FIG. 19 illustrates in greater detail the Venue Positioning System (VPS)of FIG. 18 in accordance with the disclosed embodiments;

FIG. 20 depicts a flowchart of operations illustrative of a method forproviding multiple venue activities through a hand held device inaccordance with the disclosed embodiments; and

FIG. 21 illustrates a flowchart of operations illustrative of a methodfor providing multiple venue activities through a hand held device fromone or more digital video cameras in accordance with the disclosedembodiments.

DETAILED DESCRIPTION

The particular values and configurations discussed in these non-limitingexamples can be varied and are cited merely to illustrate at least oneembodiment and are not intended to limit the scope thereof.

FIG. 1 depicts a schematic diagram illustrating a general hardwareconfiguration of a hand held device 11 in accordance with an embodimentof the disclosed embodiments. Those skilled in the art can appreciate,however, that other hardware configurations with less or more hardwareand/or modules may be utilized in carrying out the methods and systems(e.g., hand held device 11) of the disclosed embodiments as furtherdescribed herein. CPU 10 of hand held device 11 performs as a maincontroller operating under the control of operating clocks supplied froma clock oscillator. CPU 10 may be configured, for example, as a 16-bitmicroprocessor. External pins of CPU 10 are generally coupled to aninternal bus 26 so that it may be interconnected to respectivecomponents.

A SRAM 24 can be configured as a writeable memory that does not requirea refresh operation and can be generally utilized as a working area ofCPU 10. SRAM (Static RAM) is generally a form of semiconductor memory(RAM) based on a logic circuit known as a flip-flop, which retainsinformation as long as there is enough power to run the device. Font ROM22 can be configured as a read only memory for storing character images(e.g., font) displayable on a display 18. Examples of types of displaysthat may be utilized in accordance with display 18 include a TFT activematrix display, an illuminated LCD (Liquid Crystal Display), or othersmall-scale displays being developed.

CPU 10 of the present embodiment drives display 18 utilizing, amongother media, font images from Font ROM 22, and images transmitted asdata through wireless unit 17 and processed by image-processing module35. A EPROM 20 may be configured as a read only memory that is generallyerasable under certain conditions and can be utilized for permanentlystoring control codes for operating respective hardware components andsecurity data, such as a serial number.

An IR controller 14 can generally be configured as a dedicatedcontroller for processing infrared codes transmitted/received by an IRtransceiver 16 and for capturing the same as computer data. Wirelessunit 17 can generally be configured as a dedicated controller andtransceiver for processing wireless data transmitted from and to awireless communications network. Note that wireless unit 17 can beimplemented as a separate module or cartridge, such as illustrated inFIG. 3. Wireless unit 17 can thus comprise a wireless module.

Port 12 can be connected to CPU 10 and can be temporarily attached, forexample, to a docking station to transmit information to and from handheld device 11 to other devices such as personal computers, retail cashregisters, electronic kiosk devices, and so forth. Port 12 can also beconfigured, for example, to link with a modem, cradle or dockingstation, which are well known in the art, that permit network devices, apersonal computer or other computing devices to communicate with handheld device 11.

User controls 32 permit a user to enter data to hand held device 11 andinitiate particular processing operations via CPU 10. A user interface33 may be linked to user controls 32 to permit a user to access andmanipulate hand held device 11 for a particular purpose, such as, forexample, viewing images on display 18. Those skilled in the art willappreciate that user interface 33 may be implemented as a touch screenuser interface, as indicated by the dashed lines linking display 18 withuser interface 33. In addition, CPU 10 may cause a sound generator 28 togenerate sounds of predetermined frequencies from a speaker 30. Speaker30 may be utilized to produce music and other audio informationassociated with video data transmitted to hand held device 11 form anoutside source.

Those skilled in the art can appreciate that additional electroniccircuits or the like other than, or in addition to, those illustrated inFIG. 1 may be used to construct hand held device 11. Such components,however, are not described in the present specification, because manyaspects of them are well known in the art. For example, hand heldtelevisions are available for receiving public television broadcasts,but the basic technology can be modified on such devices so that theymay be adapted to (e.g., proper authentication, filters, security codes,or the like) receive venue-based RF transmissions from at least onevenue-based RF source (e.g., a wireless camera, or data from a cameratransmitted wirelessly through at least one transmitter). Those skilledin the art can thus appreciate that because of the brevity of thedrawings described herein, only a portion of the connections between theillustrated hardware blocks is generally depicted. In addition, thoseskilled in the art will appreciate that hand held device 11 can beimplemented as a specific type of a hand held device, such as a PersonalDigital Assistant (PDA), paging device, WAP-enabled mobile phone, andother associated hand held computing devices well known in the art.

Given the teaching of various embodiments of the disclosed embodiments,it should be appreciated that a hand held device 11 can be configured topermit images, similar to television broadcast images, to be displayedon display 18 for a user to view. Hand held device 35 thus includes animage-processing unit 35 for processing images transmitted as data tohand held device 11 through wireless unit 17. A tuner unit 34,implemented as either a single tuner or a plurality of tuners, may belinked through internal bus 26 to CPU 10. Additionally, a security unit36 may be utilized to process proper security codes to thereby ensurethat data transferred to and from hand held device 11 may be secureand/or permitted. Broadcast security prevents general receipt of venueimages without proprietary hardware and/or signals.

Security unit 36 may be implemented as an optional feature of hand helddevice 11. Security unit 36 can also be configured with software, e.g.,algorithm routines or subroutines, that are processed by CPU 10, andwhich prevent wireless data from being transmitted/received from handheld device 11 beyond a particular frequency range, outside of aparticular geographical area associated with a local wireless network,or absent authorization codes (e.g., decryption, encryption, coding,decoding, and so forth). Note that security unit 36 can be implementedas a separate security module, such as, for example, a smart card, orcartridge. An example of a module, which may be implemented inaccordance with the methods and systems of the disclosed embodiments, isillustrated in FIG. 3. A security module of this type may be utilizedfor securing data transmitted from or to a hand held device such as, forexample, hand held device 11.

Hand held device 11 can thus be configured with both wireless and wireline capabilities, depending on the needs and requirements of amanufacturer or customer. Such wireless capabilities include featuressuch as those found in cellular telephone units, in accordance withcarrying out embodiments of the disclosed embodiments. Current examplesof hand held devices that can be utilized in accordance with the methodsand systems of the disclosed embodiments include the “PalmPilot™” PDA,manufactured and sold by Palm Computing, the Handspring Visor™, WindowCE™ compatible devices, RIM™ Blackberry-family paging devices, Motorolapaging devices, hand held portable televisions, and the Symbol™.SPT-family of PDA-type organizer devices. Such hand held devices arementioned herein for illustrative purposes only and are not consideredlimiting features of the disclosed embodiments. Hand held devices whichmay also be implemented in accordance with the methods and systems ofthe disclosed embodiments include hand held devices, such as cellulartelephones having viewable display screens for the display of datatransmitted through wireless networks. Customized, venue-specificdevices (i.e., proprietary, limited use) may be also developed inaccordance with the methods and systems of the disclosed embodimentsthat incorporate hardware and software modules necessary to practice themethods and systems taught herein.

Those skilled in the art can appreciate that although hand held device11 is generally illustrated in FIG. 1, hand held device 11 can beimplemented as a wireless application protocol (WAP) web-enabledcellular hand held device, such as a PDA, wireless telephone, or pageror a combination thereof. Hand held device 11 can also be configuredwith features of combination cellular telephone/PDA devices. One recentexample of such a device is the Handspring™ PDA and associated cellularphone attachment module, which is manufactured and sold by Handspring™.Inc. Other such devices include the Palm-Motorola phone, which permitsusers to access e-mail and store calendars and contact databases. Handheld devices may also be provided in the form of a multi-RF (RadioFrequency) receiver-enabled hand held television-viewing device, such asthose manufactured by Sony™ and Casio™. Regardless of the type of handheld device implemented, it is anticipated that such hand held deviceswill be adapted to receive and process data via image-processing unit 35for ultimate display as moving images on display unit 18, in accordancewith the disclosed embodiments. Image-processing unit 35 may includeimage-processing routines, subroutines, software modules, and so forth,to perform image-processing operations.

FIG. 2 illustrates a pictorial representation of a hand held device 40that may be utilized to implement preferred embodiments of the disclosedembodiments. Hand held device 40 includes a display screen 42, which isgenerally analogous to display 18 of FIG. 1. Television images broadcastvia radio frequency or digital data may be displayed on display screen42 for a user to view. User controls 44 can permit a user to selectand/or manipulate images or text displayed on display screen 42. Usercontrols 44 of FIG. 2 are generally analogous to user controls 32 ofFIG. 1. A touch screen user interface may be further configured on thedisplay screen 42 with hand held device 40 to permit a user tomanipulate images/text displayed on display screen 42.

FIG. 3 depicts a pictorial representation of a hand held device 56adapted for receiving a module 50, in accordance with preferredembodiments of the disclosed embodiments. Although hand held device 56of FIG. 3 is generally analogous to hand held device 40 of FIG. 2, thedifference being that hand held device 56 may be adapted to receive amodule/cartridge that permits hand held device 56 to function accordingto specific hardware, codes and/or instructions contained in a memorylocation (e.g., a computer chip or magnetic strip) within module 50.Module 50 can be configured as a smart card, well known in the art. Sucha smart card may provide, for example, access codes (e.g., decryption)to enable hand held device 56 to receive venue broadcasts. Note that asutilized herein, the term “module” may refer to a physical module, suchas a cartridge. The term “module” may also refer to a software modulecomposed of routines or subroutines that perform a particular function.Those skilled in the art can appreciate the meaning of the term moduleis based on the context in which the term is utilized and environmentbeing described. Thus, module 50 as illustrated can be generallyconfigured as a physical cartridge or smart card. The term “module” asutilized herein may also refer to a software module, depending on thecontext of the discussion thereof.

To illustrate the use of a physical module, such as module 50, assumethat a user may possess several such physical modules or cartridges. Onemodule, when inserted into hand held device FIG. 3 may instruct handheld device 50 to function as a standard PDA, such as a Palm Pilotdevice. Another module, when inserted into hand held device FIG. 3, mayinstruct hand held device 56 to function as a portable television thatreceives wireless television broadcasts and/or data from a localwireless broadcast network and/or venue-based (e.g., short range)broadcasts. Such a module can also incorporate decryption capabilitiesto receive controlled/secured broadcasts at venues.

Those skilled in the art can thus appreciate that hand held device 56can be adapted to receive and cooperate with module 50. Additionally,hand held device 56 includes a display screen 52 that is generallyanalogous to display screen 42 of FIG. 2 and display 18 of FIG. 1. Handheld device 56 also includes user controls 54 that are generallyanalogous to user controls 44 of FIG. 2 and user controls 32 of FIG. 1.Hand held device 56 of FIG. 3 is generally analogous to hand held device11 of FIG. 1. Thus, hand held device 56 can also implement touch screencapabilities through a touch screen user interface integrated withdisplay screen 52.

Assuming module 50 is implemented as a smart card instead of a cartridgeto provide receiver and/or securing capabilities (e.g., encryption,decryption, coding, decoding, etc.), it is anticipated that similarfeatures can be implemented in accordance with a smart card to insurethat hand held device 56 includes touch screen user interface and videoviewing capabilities. Smart cards are generally known in the art ascredit card sized plastic cards with an embedded computer chip. The chipcan either be a microprocessor with internal memory or a memory chipwith non-programmable logic. The chip connection can be configured viadirect physical contact or remotely through a contactlesselectromagnetic interlace.

Smart cards may be generally configured as either a contact orcontactless smart card, or a combination thereof. A contact smart cardrequires insertion into a smart card reader (e.g., contained within handheld device 56) with a direct connection to, for example, a conductivemicromodule on the surface of the card. Such a micromodule may begenerally gold plated. Transmission of commands, data, and card statustakes place through such physical contact points.

A contactless card requires only close proximity to a reader. Both thereader and the card may be implemented with antenna means providing acontactless link that permits the devices to communicate with oneanother. Contactless cards can also maintain internal chip power or anelectromagnetic signal (e.g., RF tagging technology). Two additionalcategories of smart codes, well known in the art, which are based oncontact and contactless cards are the so-called Combi cards and Hybridcards.

A Hybrid card generally may be equipped with two chips, each with arespective contact and contactless interface. The two chips are notconnected, but for many applications, this Hybrid serves the needs ofconsumers and card issuers. The Combi card may be generally based on asingle chip and can be generally configured with both a contact andcontactless interface.

Chips utilized in such smart cards are generally based on microprocessorchips or memory chips. Smart cards based on memory chips depend on thesecurity of the card reader for their processing and can be utilizedwhen low to medium security requirements. A microprocessor chip can add,delete and otherwise manipulate information in its memory.Microprocessor-based memory cards typically contain microprocessor chipswith 8, 16, and 32 bit architectures.

FIG. 4 illustrates a system 58 for providing multiple perspectivesthrough a hand held device 60 of activities at a venue 80, in accordancewith preferred embodiments of the disclosed embodiments. Forillustrative purposes only, it may be assumed that venue 80 of FIG. 4 isa stadium venue, such as a football stadium. Cameras 71, 73, 75, and 77are respectively positioned at strategic points about venue 80 tocapture the best images of activity taking place within venue 80.Cameras 71, 73, 75, 77 are respectively linked to transmitters 70, 72,74, and 76. Each of these transmitters may be configured as equipment,which feeds a radio signal to an antenna for transmission. The equipmentmay also provide for the securing transmission of signals and associateddata. For example, such equipment can rely on the encryption of signals.These signals, if encrypted, can be decrypted by authorized hand heldreceivers.

The antenna may be integrated with the transmitter. Transmitters arewell known in the art, and include active components, such as a driver,well known in the art. Transmitters also include passive components,such as a TX filter, also well known in the art. These components, whenoperating together, impress a signal onto a radio frequency carrier ofthe correct frequency by immediately adjusting its frequency, phase, oramplitude, thereby providing enough gain to the signal to project it toits intended target (e.g., a hand held device located within the venue).

A hand held device 60 may be held by a user at a stadium seat withinview of the activity at the venue 80. Hand held device 60 is generallyanalogous to hand held device 11 of FIG. 1 and hand held device 40 ofFIG. 2. Hand held device 60 of FIG. 4 may be configured as a hand helddevice (e.g., PDA, portable television, etc.) adapted for use with acartridge/module, such as module 50 of hand held device 56 of FIG. 3.The cartridge/module may contain the electronics (e.g., tuner(s),filter(s), security codes, encryption/decryption codes, etc.) to allow ahand held device to be adapted for receiving venue-based data. Hand helddevice 60 includes a display screen 61 (e.g. display 18 of FIG. 1).

Additionally, display screen 61 of hand held device 60 may be configuredwith a touch screen user interface displayable and operable on displayscreen 61. Those skilled in the art can appreciate that touch screeninterfaces are well known in the PDA art and further explanation thereofshould not be necessary. Display screen 61 can include a touch screendisplay area 65 that may be associated with camera 71. Thus, imagescaptured by camera 71 are transmitted from transmitter 70, which islinked to camera 71. Additionally, display screen 61 includes touchscreen display areas 69, 63, and 67, which are respectively associatedwith cameras 73, 75, and 77.

Cameras 71, 73, 75, and 77 are respectively labeled C₁, C₂, C₃, andC_(N) to indicate that a plurality of cameras may be utilized inaccordance with system 58 to view activities taking place within venue80, such as a football game or concert. Although only four cameras areillustrated in FIG. 4, those skilled in the art will appreciate thatadditional or fewer cameras may be also implemented in accordance withsystem 58. Touch screen display areas 65, 69, 63, and 67 are alsorespectively labeled C₁, C₂, C₃, and C_(N) to illustrate the associationbetween these display areas and cameras 71, 73, 75, and 77 where touchscreen technology is utilized.

Hand held device 60 can be integrated with one or more plurality oftuners, as illustrated by tuners 62, 64, 66, and 68. Such tuners can beactivated via user controls on hand held device 60 and/or via touchscreen icons or areas displayed on display screen 61 that are associatedwith each tuner. Such icons/areas may be respectively displayed withindisplay areas 65, 69, 63 and 67, or within a separate display area ofdisplay screen 61 (e.g., picture-within-picture capabilities found onlarge television sets). A user accesses tuner 62, for example, toretrieve real-time video images transmitted from transmitter 70 forcamera 71. Likewise, a user can access tuner 64 to retrieve real-timevideo images transmitted from transmitter 72 for camera 73.

In addition, a user can access tuner 74 to retrieve real-time videoimages transmitted from transmitter 74 for camera 75. Finally, user canaccess tuner 68 to retrieve real-time video images transmitted fromtransmitter 76 for camera 77. In the example depicted in FIG. 4, afootball player 82 is participating in a football game within venue 80.Cameras 71, 73, 75, and 77 capture moving images (e.g., video data) ofthe football player 82 from various angles and transmit these images tohand held device 60.

FIG. 5 depicts a system 59 that provides multiple perspectives ofactivity at a venue 80 through a hand held device 60 adapted to receiveand process real time video data in accordance with preferredembodiments of the disclosed embodiments. Note that in FIG. 4 and FIG. 5analogous parts are indicated by identical reference numerals. Thus, forexample, cameras 71, 73, 75, and 77 of FIG. 5 are analogous to cameras71, 73, 75, and 77 of FIG. 4. Hand held device 60 of FIG. 5 is alsoanalogous to hand held device 60 of FIG. 4 and includes similar featuresthereof.

Hand held device 60 of FIG. 5, however, can be configured to receivewireless real time video data transmitted for cameras 71, 73, 75, and 77respectively through data transmitters 102, 104, 106, and 108 to server100 and thereafter to wireless data transmitter/receiver 110. Note thatwireless data transmitter/receiver 110 is analogous to wireless unit 17of FIG. 1. Hand held device 60 of FIG. 5 is also analogous to hand helddevice 11 of FIG. 1.

Hand held device 60 of FIG. 5 can also incorporate a touch screen userinterface, as described herein with respect to analogous hand helddevice 60 of FIG. 4. The difference between system 58 of FIG. 4 andsystem 59 of FIG. 5 lies in the inclusion of digital transmitters 102,104, 106, and 108 which are respectively linked to cameras 71, 73, 75,and 77 of FIG. 5. In the illustration of FIG. 5, cameras 71, 73, 75, and77 may be configured as high definition video cameras which capture realtime images of events or activities taking place within venue 80, suchas real time video footage of football player 82.

A captured image of football player 82, for example, can be transferredfrom one or more of video cameras 71, 73, 75, and 77 of FIG. 5 andtransmitted through a respective digital transmitter, such as digitaltransmitter 102, 104, 106 or 108 and transmitted via wired and/orwireless communications to server 100. The server 100 then processes thevideo data received from one or more of the digital transmitters andformats the video data for transmission via wireless means to wirelessdata transmitter/receiver 100, which may be integrated with hand helddevice 100. Transmitter/receiver 100 can communicate with the variouscomponents of hand held device 60, such as a CPU, image-processing unit,memory units, and so forth.

Those skilled in the art can appreciate that although real time videodata may be transmitted to server 100, captured past video images mayalso be stored within server 100 and transferred to hand held device 60for display at display screen 61. For example, instant replays may betransferred as video data to hand held device 60 upon the request of auser of hand held device 60. Such instant replay footage can bedisplayed on display screen 61 for the user to view.

FIG. 6 illustrates a system 79 for providing multiple perspectives ofactivity at a venue 80 through a hand held device 60 adapted to receiveand process real time video data from at least one wide-angle and/orpanoramic video camera 114, in accordance with preferred embodiments ofthe disclosed embodiments. In system 79 of FIG. 6, wide-angle/panoramic(hereinafter referred to as “panoramic”) video camera 114, may beconfigured as a high-definition panoramic video camera that capturesimages of activities taking place at venue 80. In the exampleillustrated in FIG. 6, panoramic video camera 114 can capture of imagesof a football game and one or more football players, such as illustratedfootball player 82.

A data transmitter 112 may be linked to panoramic video camera 114.Video data captured by panoramic video camera 114 may be transferred todata transmitter 112, which thereafter transmits the video data toserver 100 via a direct link or wireless link, depending on the needs orrequirements of the promoters or venue owners. Note that this is alsotrue of the system described in FIG. 6. Server 100 of FIG. 6 isanalogous to server 100 of FIG. 5. Thus, in the case of FIG. 5, videodata may be transmitted from one or more of data transmitters 102, 104,106, and 108 via a direct wire/cable link or through wirelesstransmission means, such as through a wireless network.

Those skilled in the art will appreciate, of course, that hand helddevice 60 of FIG. 6 is analogous to hand held devices depicted in FIGS.1-5 herein. In FIGS. 4, 5, and 6, like or analogous parts are identifiedby identical reference numerals. Thus, images captured by panoramicvideo camera 114 of activity taking place at venue 80 may be displayedas real time video images or instant replay data on display screen 61 ofhand held device 60.

FIG. 7 depicts a system 89 for providing multiple perspectives foractivity at a venue 120 at a first time and/or perspective (Time 1) anda second time and/or perspective (Time 2), in accordance with preferredembodiments of the disclosed embodiments. In FIGS. 4, 5, 6, and 7, likeor analogous parts are indicated by identical reference numerals. Thus,in system 89 of FIG. 7, an event, in this case illustrated as a hockeygame, is taking place within venue 120. Venue 120 may be, for example, ahockey arena. Panoramic video camera 114 may be linked to datatransmitter 112.

As explained previously, data transmitter 112 may be linked to server100 via a direct link, such as a transmission cable or line, or throughwireless communication means, such as through a wireless network. Server100 can also communicate with hand held device 60 through a wirelessnetwork or other wireless communication means by transmitting datathrough such a network or wireless communications means to wireless datatransmitter/receiver 110. Wireless data transmitter/receiver 110, asexplained previously, may be integrated with hand held device 60.

Thus, a video image 124 of a hockey player 122 can be captured as videodata by panoramic video camera 114, along with a video image 126 of ahockey player 123 and displayed within display screen 61 of hand helddevice 60 as indicated at Time 1. Video image 124 and 126 can bedisplayed within a grid-like interface on display screen 61. Note thatin the illustration of FIG. 7, display screen 61 may be divided intofour sections.

When a user touches, for example the area or section of display screen61 in which video image 124 may be displayed, the entire display area ofdisplay screen 61 can then be consumed with a close-up video shot ofvideo image 124, as indicated at Time 2, thereby providing the user witha closer view of hockey player 122. Those skilled in the art canappreciate that the touch screen display area of display screen 61 canbe arranged with graphical icons and/or user-controls that performspecific pan and zoom functions. Such icons/user-controls, whenactivated by a user, permit the user to retrieve panned/zoomed images ofevents taking place in real time within venue 120.

Note that although only one panoramic video camera 114 and one datatransmitter 112 are illustrated in FIG. 7, a plurality of panoramicvideo cameras, servers, and data transmitters may be implemented inaccordance with the disclosed embodiments to capture the best videoimages, image-processing, and signal capacity to users, whether realtime or otherwise, of events taking place at venue 120.

FIG. 8 illustrates a system 92 for providing multiple perspectivesthrough hand held device 60 of an activity at a venue 130, including theuse of a wireless gateway 124, in accordance with a preferred embodimentof the disclosed embodiments. Those skilled in the art can appreciatethat wireless gateway 124 may be configured as an access point for awireless LAN (Local Area Network). Access points for wireless LANnetworks and associated wired and wireless hardware (e.g., servers,routers, gateways, etc.) are well known in the art and may be utilizedin accordance with the disclosed embodiments described herein. Again,note that in FIGS. 4, 5, 6, 7, and 8, like or analogous parts areindicated by identical reference numerals. System 92 of FIG. 8 isanalogous to system 89 of FIG. 7, the difference being in the nature ofthe venue activity. Venue 130 can be, for example, a concert hall orstadium configured with a sound stage.

Gateway 124 can be configured as a communications gateway through whichdata may enter or exit a communications network, such as wirelessnetwork 152 illustrated in FIG. 9 for a large capacity of user handdevice 60 users. Wireless network 152 may be configured as a wirelessLAN network. Hand held device 60 can be configured to communicate andreceive transmissions from such a wireless LAN network based on deviceidentification (e.g., device address). Communication with hand helddevices, such as hand held device 60, however, may also be, achievedthrough RF (Radio Frequency) broadcasts, thereby not requiring two-waycommunication and authentication between, for example, a wireless LANnetwork and such hand held devices. A broadcast under such a scenariomay also require that such a hand held device or hand held devicespossess decryption capabilities or the like in order to be authorized toreceive transmissions from the venue.

The remaining elements of FIG. 8 are also analogous to the elementsdepicted in the previous drawings, with the addition of wireless gateway124, which may be linked to server 100 and may be in communication withseveral wireless data transmitters/receivers 110 and one or moreelectronic hand held devices, including hand held device 60. Wirelessdata transmitter/receiver 110, as explained previously, may beintegrated with hand held device 60. One or more panoramic videocameras, such as panoramic video camera 114, can be positioned at avenue 130 at locations that capture images not only of the events takingplace on a concert stage, but also events taking place within thestadium itself.

If an audience member 140, for example, happens to be walking along astadium aisle within view of panoramic video camera 114, the audiencemember's video image can be displayed as video image 144 within displayscreen 61 of hand held device 60, as indicated at Time 1. Likewise,panoramic video camera 114 captures images of band member 138 whosevideo image can be displayed as video image 142 within a display area ofdisplay screen 61, as indicated at Time 1.

Thus, a user of hand held device 60 can view not only the events takingplace on a central performing platform of venue 130, but also otherevents within the arena itself. The band member 138 may be located on acentral performing platform (not shown) of venue 130 when panoramicvideo camera 114 captures real-time video images of band member 138. Theuser may also, for example, wish to see a close-up of audience member140. By activating user controls and/or a touch screen interfaceintegrated with display screen 61, the user can, for example, pan orzoom to view a close-up video shot of audience member 140, as indicatedat Time 2.

Captured video images are transferred from panoramic video camera 114 asvideo data through transmitter 112 to server 100 and through wirelessgateway 124 to wireless data transmitter/receiver 110. Although a singleserver 100 is illustrated in FIG. 8, those skilled in the art canappreciate that a plurality of servers and/or wireless gateways can beimplemented in accordance with the methods and systems of the disclosedembodiments to process and deliver captured and transmitted video data.Based on the foregoing, those skilled in the art can appreciate thatvideo data may be simultaneously transferred from server 100 or aplurality or servers to literally thousands of hand held devices locatedwithin the range of the wireless network and/or wireless gatewaysassociated with venue 130.

FIG. 9 illustrates a system 150 for providing multiple perspectivesthrough hand held device 60 of an activity at a venue 130 in associationwith a wireless network 152, in accordance with preferred embodiments ofthe disclosed embodiments. System 150 of FIG. 9 is analogous to system92 of FIG. 8, the difference noted in the inclusion of wireless network152. Thus, in FIG. 8 and FIG. 9, like or analogous parts are indicatedby identical reference numerals. Video data captured by a camera orcameras, such as panoramic video camera 114, may be transferred to datatransmitter 112, which transmits the video data to wireless network 152.Wireless network 152 then retransmits the data, at the request ofauthorized users of hand held devices, such as hand held device 60, towireless data transmitters/receivers, such as transmitter/receiver 110integrated with hand held device 60.

Those skilled in the art can appreciate that wireless network 152 mayalso receive and retransmit other data, in addition to video data. Forexample, a server or other computer system may be integrated withwireless network 152 to provide team and venue data, which can then betransferred to wireless data transmitter receiver 110 from wirelessnetwork 152 and displayed thereafter as team and venue informationwithin display screen 61 of hand held device 60. Other data that may betransferred to hand held device for display include real-time andhistorical statistics, purchasing, merchandise and concessioninformation, and additional product or service advertisements.

Such data can include box scores, player information and matchups,animated playbooks, shot/hit/pitch charts, historical information, andoffense-defense statistics. In a concert venue, for example, as opposedto a sporting event, information pertaining to a particular musicalgroup can be also transferred to the hand held device, along withadvertising or sponsor information. Note that both the video data andother data described above generally comprise types of venue-based data.Venue-based data, as referred to herein, may include data andinformation, such as video, audio, advertisements, promotionalinformation, propaganda, historical information, statistics, eventscheduling, and so forth, associated with a particular venue and/or itsadvertisers/sponsors generally not retrievable through public networks.

Such information can be transmitted together with video data receivedfrom data transmitter 112. Such information may be displayed asstreaming data within display area 61 of hand held device 60 or simplystored in a database within hand held device 60 for later retrieval bythe user.

One example of a wireless network that may be utilized to implementwireless network 152 can be Bluetooth, which is described in greaterdetail herein, and was conceived originally to make up for theshortcomings of infrared technologies (IR). Because IR cannot beutilized to penetrate walls, carry data heavy signals, or operate withindevices that are not in line of sight, Bluetooth, which is becoming wellknown the art, can be configured as or with wireless network 152.

FIG. 10 illustrates an entity diagram 170 depicting network attributesof wireless network 152 that may be utilized in accordance withpreferred embodiments of the disclosed embodiments. A wireless network152 as illustrated in FIG. 10 can be configured as a variety of possiblewireless networks. Thus, entity diagram 170 illustrates attributes ofwireless network 152, which may or may not be exclusive of one another.

Those skilled in the art can appreciate that a variety of possiblewireless communications and networking configurations may be utilized toimplement wireless network 152. Wireless network 152 may be, forexample, implemented according to a variety of wireless protocols,including cellular, Bluetooth, and 802.11 RF or direct IRcommunications. Wireless network 152 can be implemented as a singlenetwork type or a network based on a combination of network types (e.g.,Bluetooth, CDMA, etc).

Wireless network 152 may be configured with teachings/aspects of CDPD(Cellular Digital Packet Data) networks well known in the networkingarts. CDPD network 154 is illustrated in FIG. 10. CDPD may be configuredas a TCP/IP based technology that supports Point-to-Point (PPP) orSerial Line Internet Protocol (SLIP) wireless connections to mobiledevices, such as the hand held devices described and illustrated herein.Mobility and/or cellular service are generally available throughout theworld from major service providers. Data can be transferred utilizingCDPD protocols.

Current restrictions of CDPD are not meant to limit the range orimplementation of the method and system described herein, but aredescribed herein for illustrative purposes only. It is anticipated thatCDPD will be continually developed, and that such new developments canbe implemented in accordance with the disclosed embodiments.

Wireless network 152 may preferably be also configured withteachings/aspects of a Personal Area Network 156 or Bluetooth, asdescribed herein. Bluetooth was adopted by a consortium of wirelessequipment manufacturers referred to at the Bluetooth Special InterestGroup (BSIG), and has emerged as a global standard for low cost wirelessdata and voice communication. Current specifications for this standardcall for a 2.4 GHz ISM frequency band. Bluetooth technology is generallybased on a short-range radio transmitter/receiver built into smallapplication specific circuits (ASICS, DSPs) and embedded into supportdevices, such as the hand held devices described and illustrated herein.

The Bluetooth standard permits up to 100 mw of power, which can increasethe range to 100 M. In addition, Bluetooth can support several datachannels. Utilizing short data packets and frequency hopping of up to1600 hops per second, Bluetooth is a wireless technology that can beutilized to enable the implementation of the methods and systemsdescribed herein. Current restrictions of Bluetooth are not meant tolimit the range or implementation of the disclosed embodiments, but aredescribed herein for illustrative purposes only. It is anticipatedBluetooth will be continually developed, and that such new developmentscan be implemented in accordance with the disclosed embodiments.

Wireless network 152 may also be configured utilizing teachings/aspectsof GSM network 158. GSM (Global System for Mobile Communication) and PCS(Personal Communications Systems) networks, both well known in thetelecommunications arts, generally operate in the 800 MHz, 900 MHz, and1900 MHz range. PCS initiates narrowband digital communications in the900 MHz range for paging, and broadband digital communications in the1900 MHz band for cellular telephone service. In the United States, PCS1900 is generally equivalent to GSM 1900. GSM operates in the 900 MHz,1800-1900 MHz frequency bands, while GSM 1800 is widely utilizedthroughout Europe and many other parts of the world.

In the United States, GSM 1900 is generally equivalent to PCS 1900,thereby enabling the compatibility of these two types of networks.Current restrictions of GSM and PCS are not meant to limit the range orimplementation of the disclosed embodiments, but are described hereinfor illustrative purposes only. It is anticipated that GSM and PCS willbe continually developed, and that aspects of such new developments canbe implemented in accordance with the disclosed embodiments.

Wireless network 152 may also utilize teachings/aspects of GPRS network160. GPRS technology, well-known in the telecommunications arts, bridgesthe gap between current wireless technologies and the so-called “nextgeneration” of wireless technologies referred to frequently as thethird-generation or 3G wireless technologies. GPRS is generallyimplemented as a packet-data transmission network that can provide datatransfer rates up to 115 Kbps. GPRS can be implemented with CDMA andTDMA technology and supports X.25 and IP communications protocols, allwell known in the telecommunications arts. GPRS also enables features,such as Voice over IP (VoIP) and multimedia services. Currentrestrictions of GPRS are not meant to limit the range or implementationof the disclosed embodiments, but are described herein for illustrativepurposes only. It is anticipated that GPRS will be continually developedand that such new developments can be implemented in accordance with thedisclosed embodiments.

Wireless network 152 may also be implemented utilizing teaching/aspectsof a CDMA network 162 or CDMA networks. CDMA (Code Division MultipleAccess) is a protocol standard based on IS-95 CDMA, also referred tofrequently in the telecommunications arts as CDMA-1. IS-95 CDMA isgenerally configured as a digital wireless network that defines how asingle channel can be segmented into multiple channels utilizing apseudo-random signal (or code) to identify information associated witheach user. Because CDMA networks spread each call over more than 4.4trillion channels across the entire frequency band, it is much moreimmune to interference than most other wireless networks and generallycan support more users per channel.

Currently, CDMA can support data at speeds up to 14.4 Kbps. Wirelessnetwork 152 may also be configured with a form of CDMA technology knownas wideband CDMA (W-CDMA). Wideband CDMA may be also referred to as CDMA2000 in North America. W-CDMA can be utilized to increase transfer ratesutilizing multiple 1.25 MHz cellular channels. Current restrictions ofCDMA and W-CDMA are not meant to limit the range or implementation ofthe disclosed embodiments, but are described herein for illustrativepurposes only. It is anticipated that CDMA and W-CDMA will becontinually developed and that such new developments can be implementedin accordance with the disclosed embodiments.

Wireless network 152 may be also implemented utilizing teachings/aspectsof paging network 164. Such paging networks, well known in thetelecommunications arts, can be implemented in accordance with thedisclosed embodiments to enable transmission or receipt of data over theTME/X protocol, also well known in the telecommunications arts. Such aprotocol enables notification in messaging and two-way data coverageutilizing satellite technology and a network of base stationsgeographically located throughout a particular geographical region.Paging network 162 can be configured to process enhanced 2-way messagingapplications.

Unified messaging solutions can be utilized in accordance with wirelessnetwork 152 to permit carriers and Internet service providers to managecustomer e-mail, voice messages and fax images and can facilitatedelivery of these communications to PDAs, telephony devices, pagers,personal computers and other capable information retrieval devices,wired or wireless.

Current restrictions of such paging networks are not meant to limit therange or implementation of the disclosed embodiments, but are describedherein for illustrative purposes only. It is anticipated that suchpaging networks, including those based on the TME/X protocol, will becontinually developed and that such new developments can be implementedin accordance with the disclosed embodiments.

Wireless network 152 may also be configured utilizing teachings/aspectsof TDMA networks 166. TDMA (Time Division Multiple Access) is atelecommunications network utilized to separate multiple conversationtransmissions over a finite frequency allocation of through-the-airbandwidth. TDMA can be utilized in accordance with the disclosedembodiments to allocate a discrete amount of frequency bandwidth to eachuser in a TDMA network to permit many simultaneous conversations ortransmission of data. Each user may be assigned a specific timeslot fortransmission. A digital cellular communications system that utilizesTDMA typically assigns 10 timeslots for each frequency channel.

A hand held device operating in association with a TDMA network sendsbursts or packets of information during each timeslot. Such packets ofinformation are then reassembled by the receiving equipment into theoriginal voice or data/information components. Current restrictions ofsuch TDMA networks are not meant to limit the range or implementation ofthe disclosed embodiments, but are described herein for illustrativepurposes only. It is anticipated that TDMA networks will be continuallydeveloped and that such new developments can be implemented inaccordance with the disclosed embodiments.

Wireless network 152 may also be configured utilizing teachings/aspectsof Wireless Intelligent Networks (WINs) 168. WINs are generally known asthe architecture of the wireless switched network that allows carriersto provide enhanced and customized services for mobile telephones.Intelligent wireless networks generally include the use of mobileswitching centers (MSCs) having access to network servers and databasessuch as Home Location Registers (HLRs) and Visiting Location Registers(VLRs), for providing applications and data to networks, serviceproviders and service subscribers (wireless device users).

Local number portability allows wireless subscribers to make and receivecalls anywhere—regardless of their local calling area. Roamingsubscribers are also able to receive more services, such as callwaiting, three-way calling and call forwarding. A HLR is generally adatabase that contains semipermanent mobile subscriber (wireless deviceuser) information for wireless carriers' entire subscriber base.

A useful aspect of WINs involves enabling the maintenance and use ofcustomer profiles within an HLRNLR-type database. Profile informationmay be utilized for example with season ticket holders and/or fans oftraveling teams or shows. HLR subscriber information as used in WINsincludes identity, service subscription information, locationinformation (the identity of the currently serving VLR to enable routingof communications), service restrictions and supplementaryservices/information. HLRs handle SS7 transactions in cooperation withMobile Switching Centers and VLR nodes, which request information fromthe HLR or update the information contained within the HLR. The HLR alsoinitiates transactions with VLRs to complete incoming calls and updatesubscriber data. Traditional wireless network design is generally basedon the utilization of a single HLR for each wireless network, but growthconsiderations are prompting carriers to consider multiple HLRtopologies.

The VLR may also be configured as a database that contains temporaryinformation concerning the mobile subscribers currently located in agiven MSC serving area, but whose HLR may be elsewhere. When a mobilesubscriber roams away from the HLR location into a remote location, SS7messages are used to obtain information about the subscriber from theHLR, and to create a temporary record for the subscriber in the VLR.

Signaling System No. 7 (referred to as SS7 or C7) is a global standardfor telecommunications. In the past the SS7 standard has defined theprocedures and protocol by which network elements in the public switchedtelephone network (PSTN) exchange information over a digital signalingnetwork to effect wireless and wire line call setup, routing, control,services, enhanced features and secure communications. Such systems andstandards may be utilized to implement wireless network 152 in supportof venue customers, in accordance with the disclosed embodiments.

Improved operating systems and protocols allow Graphical User Interfaces(GUIs) to provide an environment that displays user options (e.g.,graphical symbols, icons or photographs) on a wireless device's screen.Extensible Markup Language (“XML”) is generally a currently availablestandard that performs as a universal language for data, makingdocuments more interchangeable. XML allows information to be used in avariety of formats for different devices, including PCs, PDAs andweb-enabled mobile phones.

XML enables documents to be exchanged even where the documents werecreated and/or are generally used by different software applications.XML may effectively enable one system to translate what another systemssends. As a result of data transfer improvements, wireless device GUIscan be utilized in accordance with a hand held device and wirelessnetwork 152, whether configured as a paging network or another networktype, to render images on the hand held device that closely representthe imaging capabilities available on desktop computing devices.

Those skilled in the art can appreciate that the system and logicalprocesses described herein relative to FIG. 11 to FIG. 17 are notlimiting features of the disclosed embodiments. Rather, FIG. 11 to FIG.17 provide examples of image-processing systems and logical processesthat can be utilized in accordance with the disclosed embodiments. Sucha system and logical processes represent one possible technique, whichmay be utilized in accordance with one or more embodiments of thedisclosed embodiments to permit a user of a hand held device tomanipulate video images viewable on a display screen of the hand helddevice.

FIG. 11 thus illustrates a prior art overview display 200 and a detailwindow 210 that may be utilized with embodiments of the disclosedembodiments. The overview image display 200 is a view representative ofa 360.degree. rotation around a particular point in a space. While acomplete rotational view may be utilized in accordance with preferredembodiments of the disclosed embodiments, one of ordinary skill in thecomputer arts will readily comprehend that a semi-circular pan (such asused with wide-angle cameras) or other sequence of images could besubstituted for the 360 degree rotation without departing from thesubject invention. The vantage point is generally where the camera waslocated as it panned the space. Usually the scene is captured in aspherical fashion as the camera pans around the space in a series ofrows as depicted in FIG. 12. The space is divided into w rows 220-224and q columns 230-242 with each q representing another single frame asshown in FIG. 12.

User control over the scene (e.g., rotation, pan, zoom) may be providedby pressing a touch screen display icon or moving a cursor displayed ona display screen of a hand held device, such as the hand held devicesdescribed herein. User control over the scene may also be provided bymanipulating external user controls integrated with a hand held device(e.g., user controls 44 and 54 of FIG. 2 and FIG. 3). Movement from aframe in the overview image display to another frame is in one of eightdirections as shown in FIG. 13. The user may interact with the videorepresentation of the space one frame at a time. Each individual frameis an image of one of the pictures taken to capture the space asdiscussed above. The individual frames may be pieced together.

Interacting with a video one frame at a time results in the ability topresent a detailed view of the space. The user can experience theoverview image display as it unfolds a single frame at a time. In avenue application, a user may chose to view different sections of alarger area by browsing to a particular area are provided. The areachosen may be at a high resolution allowing for the user to zoom in andout of the section.

Another limitation of a simple overview viewer is that there is norandom access means. The frames can only be viewed sequentially as theoverview image display is unfolded. As adapted for use in accordancewith the disclosed embodiments, this problem has been overcome byproviding tools to browse, randomly select and trace selected imagesassociated with any overview image.

FIG. 14 illustrates a prior art overview image 300, a detail window 310and a corresponding area indicia, in this case a geometric figureoutline 320. The detail window 310 corresponds to an enlarged imageassociated with the area bounded by the geometric figure outline 320 inthe overview image 300. As the cursor is moved, the location within theoverview image 300 may be highlighted utilizing the geometric figureoutline 320 to clearly convey what location the detail window 310corresponds to.

One of ordinary skill in the computer arts will readily comprehend thatreverse videoing the area instead of enclosing it with a geometricfigure would work equally well. Differentiating the area with colorcould also be used without departing from the invention. A user canselect any position within the overview image, press the cursorselection device's button (for example, user controls in the form oftouch screen user interface buttons or icons), and an enlarged imagecorresponding to the particular area in the overview display ispresented in the detail window 310. Thus, random access of particularframes corresponding to the overview image may be provided.

FIG. 15 illustrates a prior art series of saved geometric figureoutlines corresponding to user selections in tracing through an overviewdisplay for subsequent playback. The overview image 400 has a detailwindow 410 with an enlarged image of the last location selected in theoverview image 470. Each of the other cursor locations traversed in theoverview image 420, 430, 440, 450 and 460 are also enclosed by anoutline of a geometric figure to present a trace to the user.

Each of the cursor locations may be saved, and because each correspondsto a particular frame of the overview image, the trace of frames can bereplayed at a subsequent time to allow another user to review the framesand experience a similar presentation. Locations in the detailed windowand the overview image can also be selected to present other imagesassociated with the image area, but not necessarily formed from theoriginal image.

For example, a china teacup may appear as a dot in a china cabinet, butwhen the dot is selected, a detailed image rendering of the china teacupcould appear in the detailed window. Moreover, a closed door appearingin an image could be selected and result in a detailed image of a roomlocated behind the door even if the room was not visible in the previousimage. Finally, areas in the detailed window can also be selected toenable further images associated with the detailed window to berevealed. Details of objects within a scene are also dependent onresolution capabilities of a camera. Cameras having appropriateresolution and/or image processing capabilities are preferably used inaccordance with certain aspects of the disclosed embodiments.

The overview image was created as discussed above. To assist one ofordinary skill in the art to make and use the invention, a more detaileddiscussion of the necessary processing is presented below with referenceto FIG. 16 and FIG. 17 herein.

FIG. 16 depicts a prior art flowchart providing a logical process forbuilding an overview image display. Such a logical process may beutilized in accordance with the disclosed embodiments, but is not anecessary feature of the disclosed embodiments. Those skilled in the artwill appreciate that such a logical process can merely an example of onetype of image-processing algorithm that may be utilized in accordancewith embodiments of the disclosed embodiments. For example, such alogical process may be implemented as a routine or subroutine that runsvia image-processing unit 35 of FIG. 1 in a hand held device. Thoseskilled in the art can appreciate that the logical process describedwith relation to FIGS. 16 and 17 herein are not limiting features of thedisclosed embodiments.

Such logical processes, rather, are merely one of many such processesthat may be utilized in accordance with the disclosed embodiments topermit a user to manipulate video images displayed via a display screenof a hand held device. Navigable movie/video data in the form of imagesinput to the hand held device to form individual images can be thusprocessed, as illustrated at function block 500. User specified windowsize (horizontal dimension and vertical dimension) may be entered, asillustrated at function block 504.

Image variables can be specified (horizontal sub-sampling rate, verticalsub-sampling rate, horizontal and vertical overlap of individual frameimages, and horizontal and vertical clip (the number of pixels areclipped from a particular frame in the x and y plane)), as depicted atfunction block 508. Function blocks 500, 504 and 508 are fed into thecomputation function block 510 where the individual frames are scaledfor each row and column, and the row and column variables are eachinitialized to one.

Then a nested loop can be invoked to create the overview image. First,as indicated at decision block 512, a test is performed to determine ifthe maximum number of rows has been exceeded. If so, then the overviewimage is tested to determine if its quality is satisfactory at decisionblock 520. If the quality is insufficient, the user may be provided withan opportunity to adjust the initial variables, as illustrated atfunction blocks 504 and 508. The processing is then repeated. If,however, the image is of sufficient quality, it can be saved anddisplayed for use, as depicted at block 560.

If the maximum rows have not been exceeded as detected in decision block512, then another test can be performed, as illustrated at decisionblock 514, to determine if the column maximum has been exceeded. If so,then the row variable can be incremented and the column variable can bereset to one at function block 518 and control flows to input block 520.If the column maximum has not been exceeded, then the column variablemay be incremented and the sub-image sample frame can be retrieved, asdepicted at input block 520. Then, as illustrated at function block 530,the frame may be inserted correctly in the overview image.

The frame may be inserted at the location corresponding to(Vsub*row*col)+Hsub*col; where row and col refer to the variablesincremented in the nested loop, and Vsub and Hsub are user specifiedvariables corresponding to the horizontal and vertical sub samplingrate. Finally, the incremental overview image can be displayed based onthe newly inserted frame as depicted at display block 540. Thereafter,the column variable can be reset to one and processing can be passed todecision block 512.

A computer system corresponding to the prior art method and systemdepicted in FIGS. 11 to 17 may be generally interactive. A user mayguess at some set of parameters, build the overview image, and decide ifthe image is satisfactory. If the image is not satisfactory, thenvariables can be adjusted and the image is recreated. This process canbe repeated until a satisfactory image results, which may be saved withits associated parameters. The picture and the parameters can be theninput to the next set of logic.

Such features may or may not be present with the hand held deviceitself. For example, images may be transmitted from a transmitter, suchas data transmitter 112 of FIG. 7, and subroutines or routines presentwithin the server itself may utilize predetermined sets of parameters tobuild the overview image and determine if the image is satisfactory,generally at the request of the hand held device user. A satisfactoryimage can be then transmitted to the hand held device. Alternatively,image-processing routines present within an image-processing unitintegrated with the hand held device may operate in association withroutines present within the server to determine if the image issatisfactory, and/or to manipulate the image (e.g., pan, zoom)

FIG. 17 depicts a prior art flowchart illustrative of a logical processfor playback interaction. The logical process illustrated in FIG. 17 maybe utilized in accordance with preferred embodiments of the disclosedembodiments. Playback interaction may commence, as illustrated at label600, which immediately flows into function block 604 to detect if usercontrols have been activated at the hand held device. Such user controlsmay be configured as external user controls on the hand held deviceitself (e.g., buttons, etc.), or via a touch screen user interfaceintegrated with hand held device display screen.

When a touch screen user input or user control button press is detected,a test can be performed to determine if a cursor is positioned in theoverview portion of the display. If so, then the global coordinates canbe converted to overview image coordinates local to the overview imageas shown in output block 612. The local coordinates can be subsequentlyconverted into a particular frame number as shown in output block 614.Then, the overview image is updated by displaying the frame associatedwith the particular location in the overview image and control flows vialabel 600 to function block 604 to await the next button press.

If the cursor is not detected in the overview image as illustrated atdecision block 610, then another test may be performed, as indicated atdecision block 620, to determine if the cursor is located in thenavigable player (detail window). If not, then control can be passedback via label 600 to function block 604 to await the next user input.However, if the cursor is located in the detail window, then as depicteda function block 622, the direction of cursor movement may be detected.As depicted at function block 624, the nearest frame can be located, andas illustrated at decision block 626, trace mode may be tested.

If trace is on, then a geometric figure can be displayed at the locationcorresponding to the new cursor location in the overview image. Theoverview image may be then updated, and control can be passed back toawait the next user input via user controls at the hand held deviceand/or a touch screen user interface integrated with the hand helddevice. If trace is not on, the particular frame is still highlighted asshown in function block 630, and the highlight can be flashed on theoverview image as illustrated at output block 632. Thereafter, controlmay be returned to await the next user input.

Although the aforementioned logical processes describe the use of acursor as a means for detecting locations in a panorama, those skilledin the art can appreciate that other detection and tracking mechanismsmay be utilized, such as, for example, the pressing of a particular areawithin a touch screen display.

FIG. 18 depicts a pictorial representation illustrative of a VenuePositioning System (VPS) 700 in accordance with preferred embodiments ofthe disclosed embodiments. FIG. 18 illustrates a stadium venue 701,which is divided according to seats and sections. Stadium venue 701 maybe utilized for sports activities, concert activities, politicalrallies, or other venue activities. Stadium venue 701 is divided, forexample, into a variety of seating sections A to N. For purposes ofsimplifying this discussion, VPS 700 is described in the context ofsections A to C only.

A venue positioning system (VPS) device 704 is positioned in section Aof stadium venue 701, as indicated at position A2. A VPS device 702 islocated within section A at position A1. In the illustration of FIG. 18,it is assumed that VPS device 702 is located at the top of a staircase,while VPS device 704 is located at the bottom of the staircase, andtherefore at the bottom of section A, near the sports field 711. A VPSdevice 706 is located near the top of section B at position B1. A VPSdevice 708 is located at the bottom of section B at position B2, nearsports field 711. Similarly, in section C, venue-positioning devices 710and 712 are respectively located at positions C1 and C2.

A hand held device 703 may be located at a seat within section A. Forpurposes of this discussion, and by way of example only, it is assumedthat hand held device 703 is being operated by a stadium attendeewatching a sporting event or other venue activity taking place on sportsfield 711. A hand held device 707 is located within section B. Hand helddevice 707, by way of example, may also be operated by a concessionaireor venue employee.

If the user of hand held device 703 desires to order a soda, hot dog, orother product or service offered by venue operators during the venueevent, the user merely presses an associated button displayed via atouch screen user interface integrated with the hand held device. Asignal is transmitted by hand held device 703, in response to the userinput to/through the VPS device, wireless network or wireless gateway aspreviously described. One or more of VPS devices 702, 704, 706, and 708may detect the signal. The VPS devices may also operate merely astransponders, in which case hand held devices will be able to determinetheir approximate location within the venue and then transmit positioninformation through wireless means to, for example, concessionpersonnel.

VPS devices 702, 704, 706, and 708 function in concert with one anotherto determine the location of hand held device 703 within section A.Triangulation methods, for example, may be used through the hand helddevice or VPS devices to determine the location of the hand held devicewithin the venue. This information is then transmitted by one or more ofsuch VPS devices either directly to hand held device 707 or initiallythrough a wireless network, including a wireless gateway and associatedserver, and then to hand held device 707. The user of hand held device707 then can directly proceed to the location of hand held device 703 tooffer concession services.

Additionally, hand held device 703 can be configured with a venue menuor merchandise list. In response to requesting a particular item fromthe menu or merchandise list, the request can be transmitted as wirelessdata from hand held device 703 through the wireless network to hand helddevice 707 (or directly to a controller (not shown) of hand held device707) so that the user (concession employee) of hand held device 707 canrespond to the customer request and proceed directly to the location ofhand held device 703 used by a customer.

FIG. 19 illustrates in greater detail the VPS 700 of FIG. 18, inaccordance with preferred embodiments of the disclosed embodiments. InFIG. 18 and FIG. 19 like or analogous parts are indicated by identicalreference numerals, unless otherwise stated. Additionally wirelessgateway 124 and server 100 of FIG. 19 are analogous to the wirelessgateway 124 and server 100 illustrated in FIG. 8. Venue positioningunits 702, 704, 706, and 708 are located within section A and section B.A wireless gateway 124 is linked to server 100. Wireless gateway 124 cancommunicate with hand held device 707 and hand held device 703.

Wireless gateway 124 can also communicate with VPS devices 702, 704,706, and 708 if the VPS devices are also operating as data communicationdevices in addition to providing mere transponder capabilities. When VPSdevices 702, 704, 706, and 708 detect the location of hand held device703 within stadium venue 701, the location is transmitted to wirelessgateway 124 and thereafter to hand held device 703. It should beappreciated that a hand held device user may also identify his/herlocation in a venue by entering location information (e.g.,seat/section/row) on the hand held device when making a request to aservice provider such as a food concession operation. The VPS deviceswill still be useful to help concession management locate concessionemployees located within the venue that are in closest proximity to thehand held device user. A wireless gateway 124 and server 100 can beassociated with a wireless network implemented in association withstadium venue 701. Those skilled in the art will appreciate that such awireless network may be limited geographically to the stadium venue 701itself and the immediate surrounding area. An example of such a wirelessnetwork, as described previously is a Bluetooth based wireless network.

The hand held devices themselves may be proprietary devices owned bypromoters or operators of stadium venue 701 and rented to patrons fortheir use while attending a venue activity. Proprietary devices willgenerally be manufactured using durable materials (e.g., similar tothose materials used on field technician digital multimeters/devicessuch as the Fluke™ line of electronic devices). Proprietary devices willalso be limited in hardware and software modules (i.e., softwareroutines/Subroutines) needed for communication with the venue system inorder to display venue activities to temporary users.

Hand held devices may also be owned by the patrons themselves that theybring into the stadium venue for their use by permission of the venuepromoter or stadium owners in return for the payment of a fee by thepatron. In return for the fee, the venue promoter or stadium owner canprovide the patron with a temporary code, which permits them to access,the wireless transmissions network and associated with the venue itself,such as wireless network 152 described herein. Patron-owned devices mayutilize modules (e.g., smart card technology to receive authorization(e.g., frequency or codes) needed to receive venue-provided video/data.Authorization may also be transferred to the patron-owned device via IRor short-range RF means. Wireless network 152 described herein may beconfigured as a proprietary wireless Intranet/Internet providing otherdata accessible by patrons through their hand held devices.

FIG. 20 depicts a flowchart of operations 740 illustrative of a methodfor providing multiple venue activities through a hand held device, inaccordance with preferred embodiments of the disclosed embodiments. Theprocess is initiated, as depicted at block 742. As illustrated next atblock 744, a venue attendee may activate at least one hand held tunerintegrated with a hand held device, such as the hand held deviceillustrated in FIG. 4. At least one tuner may be integrated with thehand held device, although more than one tuner (or other simultaneoussignal receiving capability) may be used within a hand held device insupport of other embodiments previously described.

The tuner, or tuners, is/are associated with a transmissionfrequency/frequencies of a transmitter that may be linked to aparticular camera/cameras focusing on a venue activity, or to a wirelessgateway or wireless network transmission. To view images from aparticular angle, the user can retrieve the video images from the cameraassociated with that particular perspective. The user may have to adjusta tuner until the right frequency/image is matched, as indicated atblock 756. As illustrated at block 748, captured video images aretransferred from the video camera to the transmitter associated with thecamera, or a server in control of the camera(s). Video images are thusgenerally transmitted to the hand held device at the specifiedfrequency, either in response to a user request at the hand held device,as depicted at block 750 or as a broadcast.

An image-processing unit integrated with the hand held device, asillustrated at block 752 may process transferred video images. Anexample of such an image-processing unit is image-processing unit 35 ofFIG. 1. As indicated thereafter at block 754, the video images of thevenue activity captured by the video camera can be displayed within adisplay area of the hand held device, such as display 18 of FIG. 1. Theprocess can then terminate, as illustrated at block 756 when the user nolonger desires to view the perspective.

FIG. 21 illustrates a flowchart of operations 770 illustrative of amethod for providing multiple venue activities through a hand helddevice from one or more digital video cameras, in accordance withpreferred embodiments of the disclosed embodiments. When a user of ahand held device can interact with the venue system, as indicated atblock 772, the process is initiated. As illustrated next at block 774,video images of a venue activity may be captured by one or more digitalvideo cameras.

Such digital video cameras may be panoramic/wide-angle in nature and/orconfigured as high definition/resolution video cameras, well known inthe art. The video camera or cameras may be respectively linked to datatransmitters, such as data transmitters 102, 104, 106, and/or 108 ofFIG. 5 or data transmitter 112 of FIG. 6 to FIG. 9 herein. As depictednext at decision block 778, if a user does not request a view of thevenue activity through the hand held device, the process terminates(i.e., with respect to that use), as illustrated thereafter at block779.

If, as illustrated at decision block 778, the user can request a view ofthe venue activity through the hand held device, then as describedthereafter at block 780, video data may be transferred from a datatransmitter to a server, such as server 100 of FIG. 5 to FIG. 8 herein.The video data may be stored in a memory location of the server or aplurality of servers, as indicated at block 782. The video data may bethen transferred to a wireless data transmitter/receiver integrated withthe hand held device, as indicated at block 784.

As illustrated thereafter at block 786, the video data may be processedby an image-processing unit and associated image-processing routinesand/or subroutines integrated with the hand held device. When imageprocessing is complete, the video images may be displayed in a displayarea of the hand held device. As illustrated next at block 790, if auser chooses to pan/zoom for a better view of the video images displayedwithin the hand held device, then two possible operations may follow,either separately or in association with one another.

The image-processing unit integrated with the hand held device mayprocess a user's pan/zoom request, as illustrated at block 792.Alternatively, image-processing routines and/or subroutines resident atthe server or a plurality of servers may process the user's pan/zoomrequest, following the transmission of the user's request from the handheld device to the server or plurality of servers. Such a request may betransmitted through a wireless gateway linked to the server or servers.

Image processing may occur at the server or servers if the hand helddevice is not capable of directly processing the video data and videoimages thereof due to low memory or slow CPU allocation. Likewise, someimage-processing may take place within the hand held device, while videoimage-processing requiring faster processing capabilities and increasedmemory may take place additionally at the server or servers to assist inthe final image representation displayed at the hand held device.

When image processing is complete, the pan/zoomed images can bedisplayed within a display screen or display area of the hand helddevice, as illustrated thereafter at block 796. The process thenterminates, as depicted at block 798. If the user does not requestpan/zoom, as indicated at block 790, the process may then terminate, asdescribed at block 791.

It will be appreciated that variations of the above-disclosed and otherfeatures and functions, or alternatives thereof, may be desirablycombined into many other different systems or applications. Also, thatvarious presently unforeseen or unanticipated alternatives,modifications, variations or improvements therein may be subsequentlymade by those skilled in the art which are also intended to beencompassed by the following claims.

1. A system for wirelessly transmitting venue-based data to at least onehand held device, said system comprising: at least one wireless network;at least one processor for processing data captured by at least onevenue-based video camera for transmission via said at least one wirelessnetwork to at least one hand held device, wherein said at least one handheld device comprises a display screen for displaying said data; atleast one transmitter for wirelessly transmitting said data via said atleast one wireless network to said at least one hand held device; atleast one security module for securing said data for transmission tosaid at least one hand held device by said at least one transmitter viasaid at least one wireless network.
 2. The system of claim 1 whereinsaid at least one security module further includes a security moduleassociated with said at least one hand held device, wherein saidsecurity module associated with said at least one hand held devicedecrypts said data if said data is encrypted for transmission to said atleast one hand held device via said at least one wireless network. 3.The system of claim 1 wherein said at least one hand held device furthercomprises at least one wireless module for communicating with said atleast one wireless network.
 4. The system of claim 3 wherein saidwireless module associated with said at least one hand held deviceincludes at least one 802.11 wireless module for providing wirelesscommunications access by said at least one hand held device to said atleast one wireless network and/or said wireless module includes at leastone cellular communications module for providing wireless communicationsaccess by said at least one hand held device to said at least onewireless network.
 5. The system of claim 4 wherein said at least onewireless network comprises at least an 802.11 wireless network and/or atleast a cellular communications network.
 6. The system of claim 5wherein said at least one hand held device comprises a smartphone. 7.The system of claim 2 wherein said at least one hand held device furthercomprises at least one wireless module for communicating with said atleast one wireless network.
 8. The system of claim 7 wherein saidwireless module associated with said at least one hand held deviceincludes at least one, 802.11 wireless module for providing wirelesscommunications access by said at least one hand held device to said atleast one wireless network and/or said wireless module includes at leastone cellular communications module for providing wireless communicationsaccess by said at least one hand held device to said at least onewireless network, and wherein said at least one wireless networkcomprises at least an 802.11 wireless network and/or at least a cellularcommunications network.
 9. The system of claim 8 wherein said at leastone hand held device comprises a smartphone.
 10. A system for wirelesslyproviding venue-based data to at least one hand held device, said systemcomprising: at least one hand held device comprising a module forinstructing said at least one hand held device to wirelessly receivevenue-based data from at least one wireless network, said venue-baseddata associated with at least one venue and including video, audio,statistics and advertising information, said video comprising aplurality of video perspectives; at least one transmitter for wirelesslytransmitting said venue-based data to at least one hand held device fromat least one venue-based data source through said at least one wirelessnetwork; a processor for processing said venue-based data to provideprocessed data including said audio, statistics, advertising informationand said video processed for display on a display screen associated withsaid at least one hand held device; and a display screen associated withsaid at least one hand held device for simultaneously displaying saidplurality of video perspectives and said processed data on said displayscreen of said at least one hand held device, thereby enabling a user ofsaid at least one hand held device to view more than one videoperspective at a time through said at least one hand held device inassociation with audio, statistics and advertising information.
 11. Thesystem of claim 10 wherein said at least one wireless network furtherincludes at least one wireless gateway associated with at least oneserver for processing said venue-based data in order to provide saidprocessed data for display on said display screen associated with saidat least one hand held device.
 12. The system of claim 10 wherein saidat least one hand held device comprises a cellular telephone capable ofestablishing voice communications with other cellular telephones. 13.The system of claim 10 wherein said at least one hand held deviceincludes an audio component for providing said audio associated withsaid venue-based data.
 14. The system of claim 10 wherein said at leastone venue comprises a sports arena.
 15. The system of claim 10 whereinsaid at least one venue comprises an entertainment venue.
 16. The systemof claim 10 wherein said at least one venue comprises a racing arena.17. The system of claim 10 wherein said at least one wireless networkcomprises an 802.11 wireless network.
 18. The system of claim 10 whereinsaid at least one wireless network comprises a cellular telephonenetwork.
 19. The system of claim 10 wherein said at least one wirelessnetwork comprises a cellular telephone network and/or an 802.11 wirelessnetwork and said at least one hand held device comprises a smartphonethat communicates wirelessly with said at least one wireless network.